On the Tradeoff Between Computation and Communication Costs for Distributed Linearly Separable Computation

نویسندگان

چکیده

This paper studies the distributed linearly separable computation problem, which is a generalization of many existing computing problems such as gradient coding and linear transform. A master asks ${\mathsf {N}}$ workers to compute function {K}}$ datasets, set {K}}_{\mathrm{ c}}$ combinations equal-length messages (each message one dataset). We assign some datasets each worker in an uncoded manner, who then computes corresponding returns these messages, that from answers any {N}}_{\mathrm{ r}}$ out can recover task with high probability. In literature, specific case where c}}=1$ or cost minimum has been considered. this paper, we focus on general (i.e., c}} $ cost) aim find communication cost. first propose novel converse bound under constraint popular cyclic assignment (widely considered literature), assigns cyclic way. Motivated by observation strategies for fall short achieving bound, scheme system parameters. The proposed optimal assignment when large numbers are equal small. addition, it order within factor 2 remaining cases.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Minimizing Communication Costs of Distributed Local Computation∗

A valuation algebra offers a suitable framework to represent knowledge and information. Based on this framework, several algorithms to process knowledge and pooled under the name local computation were mapped out in recent years. This paper proposes an extension of the valuation algebra framework that allows to express the costs of transmitting valuations between network hosts. Based on this mo...

متن کامل

on the relationship between iranian learners personality type and communication strategies in speaking.

چکیده شخصیت به مجموعه عوامل روانی، عقلی، احساسی، و فیزیکی تشکیل دهنده یک فرد اطلاق میشود، خصوصا فرد ازدیدگاه دیگران ( مرجع). تدابیر یاد گیری سعی در اگاهی از اقدامات زبان اموزان موفق زبان دوم یا یک زبان بیگانه را دارد که توسط خود زبان اموزان گزارش میشود،یا حین یادگیری زبان دوم یا زبان بیگانه از انها قابل مشاهده است( روبین و وندن 1987). همچنین تدابیر ارتباطی به زبان اموزان کمک می کند تا بر مشکلا...

15 صفحه اول

Depth-Bounded Communication Complexity for Distributed Computation

"!# $% !# &' )( * +& , -.-/ &0 21 , 3& , -3! 4) '5 ) 6 78 9 ;:< 3 ;:<,=! *> & 4)4) . % !? @$ @ ' A& , -.! B @1 , ? @4<&', -.!#, ' > 0C DE* F, ! -. G0 2 , H, 7 I; &' )( J K ,L-. 1 -. G + @-3, > 3, M MN, $%-3 2 , O 95 &B*? +78 9 ;:< O * % + 6: , !? @$ 0C P @$% Q *? 2 R * ,@ , A, MS& , -.-/ &0 2 , 3 ! * * , 4 T7# F&0 @! $% T ,U$% 'V? &' * J % -W!# $%MN, $%-A @ & C 6 !? @$ & 4X @$ Y:< K:E 4 4 MZ,>&...

متن کامل

Techniques for Estimating the Computation and Communication Costs of Distributed Data Mining

Distributed Data Mining (DDM) is the process of mining distributed and heterogeneous datasets. DDM is widely seen as a means of addressing the scalability issue of mining large data sets. Consequently, there is an emerging focus on optimisation of the DDM process. In this paper we present cost formulae for estimating the communication and computation time for different distributed data mining s...

متن کامل

Communication and Computation in Distributed CSP Algorithms

We introduce SensorDCSP, a naturally distributed benchmark based on a real-world application that arises in the context of networked distributed systems. In order to study the performance of Distributed CSP (DisCSP) algorithms in a truly distributed setting, we use a discrete-event network simulator, which allows us to model the impact of different network traffic conditions on the performance ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Communications

سال: 2021

ISSN: ['1558-0857', '0090-6778']

DOI: https://doi.org/10.1109/tcomm.2021.3107432